Alibaba Tongyi Lab has open-sourced ViDoRAG, a novel visual document retrieval and question answering system. ViDoRAG boasts impressive accuracy, achieving a remarkable 79.4% in benchmark tests. This system represents a significant advancement in the field of computer vision and information retrieval.

Recently, Huggingface, the world's largest open source AI community, released the latest Open LLM Leaderboard. The results show that all ten of the top-ranked open source large models are derivative models that have been fine-tuned based on Alibaba Tongyi Qwen's (Qwen) open-source model. This achievement marks Qwen's dominant position in the open-source AI field and further enhances its global influence. The Open LLM Leaderboard is widely...

The Qwen team recently announced the open-source release of their latest multimodal reasoning model, QVQ, marking an important step forward in the capabilities of artificial intelligence in visual understanding and complex problem-solving. This model is based on Qwen2-VL-72B and aims to enhance AI reasoning capabilities by combining language and visual information. In the MMMU evaluation, QVQ achieved a high score of 70.3, demonstrating significant performance improvements over Qwen2-VL-72B-Instruct in several math-related benchmark tests.

The Alibaba Tongyi Laboratory voice team announced that its open-source voice generation model CosyVoice has been upgraded to version 2.0. This upgrade marks significant progress in voice generation technology in terms of accuracy, stability, and natural experience. CosyVoice 2.0 achieves bidirectional streaming voice synthesis through the integration of offline and streaming modeling techniques, allowing for a first-package synthesis delay of up to 150ms, thereby significantly improving the responsiveness of voice synthesis.

On November 15, Alibaba Tongyi Lab launched the Code Mode, a feature that enables users to generate various applications through simple everyday language instructions, including mini games, data charts, websites, and resumes. Users can experience this new interactive method by visiting the Tongyi web version (tongyi.ai) and clicking on 'Code Mode' in the input box.

On August 30, 2024, Alibaba Damo Academy's Tongyi Qianwen team announced a significant update to its latest achievement—the Qwen2-VL model. The Qwen2-VL model has achieved remarkable improvements in image understanding, video processing, and multilingual support, setting new benchmarks for key performance indicators.

In the early hours of today, Alibaba's Tongyi Qianwen team released the Qwen2 series of open-source models. This series includes pre-trained and instruction-tuned models in five sizes: Qwen2-0.5B, Qwen2-1.5B, Qwen2-7B, Qwen2-57B-A14B, and Qwen2-72B. Key information indicates that these models show significant improvements in parameter count and performance compared to the previous generation Qwen1.5.

Alibaba's Tongyi Laboratory has released an AI animation project called Animate Anyone, which generates animated videos of characters using just a static image and skeletal animation. Cats dancing to 'Tie Shan Kao' have become a viral sensation online.

The Alibaba Tongyi Laboratory open sources the AI image generation fine-tuning framework SCEdit. The SCEdit framework supports fine-tuning for image generation tasks and demonstrates high efficiency in generation tasks. It achieves precise control in controllable generation tasks while saving training memory costs.